Systems and Methods for Providing Electrostatic Haptic Effects via a Wearable or Handheld Device

ABSTRACT

One illustrative system disclosed herein includes a computing device with an electrostatic force (“ESF”) haptic output device coupled to a surface of the computing device. The ESF haptic output device comprises a signal electrode that includes an insulation layer and a conductive layer positioned proximate to the insulation layer and the conductive layer is electrically coupled to a voltage supply to receive an amount of voltage for generating an ESF haptic effect, which can include a dynamic ESF haptic effect or a static ESF haptic effect. The ESF haptic output device can output the ESF haptic effect to the surface of the computing device to which the ESF haptic output device is coupled.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of and claims the benefit ofU.S. Non-Provisional application Ser. No. 15/290,069, filed Oct. 11,2016, and entitled “Systems and Methods for Providing ElectrostaticHaptic Effects via a Wearable or Handheld Device” the entire contents ofwhich are incorporated by reference herein for all purposes.

FIELD OF INVENTION

The present disclosure relates generally to user interface devices. Morespecifically, but not by way of limitation, this disclosure relates toproviding electrostatic haptic effects via a wearable or handhelddevice.

BACKGROUND

Many modern computing devices can be worn (e.g., a smart watch, awristband, bracelet, etc.) or held (e.g., a mobile phone, smartphone,gaming device, personal digital assistant (“PDA”), portable e-maildevice, portable Internet access device, calculator, etc.) by a user.Such devices can be used to provide content to the user or the user mayinteract with such devices (e.g., by touching a surface of the devices).

SUMMARY

Various examples of the present disclosure provide systems and methodsfor providing electrostatic haptic effects via a wearable or handhelddevice.

In one embodiment, a device of the present disclosure may comprise ahousing and a computing device disposed in the housing. The computingdevice can comprise a memory and a processor communicatively coupled tothe memory. The device also comprises a first electrostatic force(“ESF”) haptic output device disposed within a portion of the housingand in communication with the computing device and the first ESF hapticoutput device can be configured to output static ESF haptic effects. Thedevice also comprises a second ESF haptic output device disposed withinthe housing and in communication with the computing device and thesecond ESF haptic output device can be configured to output dynamic ESFhaptic effects. The first ESF haptic output device can comprise a firstconductive layer electrically coupled to a voltage source and a firstinsulation layer disposed on the first conductive layer to preventcontact between a user and the first conductive layer. The second ESFhaptic output device can comprise a second conductive layer electricallycoupled to the voltage source and a second insulation layer disposed onthe second conductive layer to prevent contact between the user and thesecond conductive layer.

In another embodiment, a method of the present disclosure may comprise:receiving a sensor signal indicating a contact between an object and aportion of a housing of a computing device; determining, in response tothe sensor signal, an ESF haptic effect based at least in part on thecontact, the ESF haptic effect including a static ESF haptic effect anda dynamic ESF haptic effect; and transmitting an ESF haptic signalassociated with the ESF haptic effect to a first ESF haptic outputdevice disposed within the portion of the housing or to a second ESFhaptic output device disposed within the portion of the housing. Thefirst ESF haptic output device can be configured to output static ESFhaptic effects and the second ESF haptic output device can be configuredto output dynamic ESF haptic effects. The first ESF haptic output devicecan comprise a first conductive layer electrically coupled to a voltagesource and a first insulation layer disposed on the first conductivelayer to prevent contact between a user and the first conductive layer.The second ESF haptic output device can comprise a second conductivelayer electrically coupled to the voltage source and a second insulationlayer disposed on the second conductive layer to prevent contact betweenthe user and the second conductive layer.

In another embodiment, a non-transitory computer-readable storage mediumof the present disclosure may comprise program code, which when executedby a processor can be configured to cause the processor to: receive asensor signal indicating a contact between an object and a portion of ahousing of a computing device; determine an ESF haptic effect based atleast in part on the contact, the ESF haptic effect including a dynamicESF haptic effect and a static ESF haptic effect; and transmit an ESFhaptic signal associated with the ESF haptic effect to a first ESFhaptic output device disposed within the portion of the housing or to asecond ESF haptic output device disposed within the portion of thehousing. The first ESF haptic output device can be configured to outputstatic ESF haptic effects and the second ESF haptic output device can beconfigured to output dynamic ESF haptic effects. The first ESF hapticoutput device can comprise a first conductive layer electrically coupledto a voltage source and a first insulation layer disposed on the firstconductive layer to prevent contact between a user and the firstconductive layer. The second ESF haptic output device can comprise asecond conductive layer electrically coupled to the voltage source and asecond insulation layer disposed on the second conductive layer toprevent contact between the user and the second conductive layer.

These illustrative examples are mentioned not to limit or define thelimits of the present subject matter, but to provide examples to aidunderstanding thereof. Illustrative examples are discussed in theDetailed Description, and further description is provided there.Advantages offered by various examples may be further understood byexamining this specification and/or by practicing one or more examplesof the claimed subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS

A full and enabling disclosure is set forth more particularly in theremainder of the specification. The specification makes reference to thefollowing appended figures.

FIG. 1 is a block diagram showing a system for providing electrostatichaptic feedback via a wearable or handheld device according to oneexample.

FIG. 2 shows an example of a haptic output device for providingelectrostatic haptic feedback via a wearable or handheld deviceaccording to one example.

FIG. 3 shows an example of a system for providing electrostatic hapticfeedback via a wearable device according to one example.

FIGS. 4A-B show another example of a system for providing electrostatichaptic feedback via a wearable device according to one example.

FIG. 5 shows another example of a system for providing electrostatichaptic feedback via a wearable device according to one example.

FIG. 6 show an example of a system for providing electrostatic hapticfeedback via a handheld device according to one example.

FIG. 7 is a flow chart of steps for performing a method for providingelectrostatic haptic feedback via a wearable or handheld deviceaccording to one example.

DETAILED DESCRIPTION

Reference now will be made in detail to various and alternativeillustrative examples and to the accompanying drawings. The samereference indicators will be used throughout the drawings and thefollowing description to refer to the same or like items. Each exampleis provided by way of explanation, and not as a limitation. It will beapparent to those skilled in the art that modifications and variationscan be made. For instance, features illustrated or described as part ofone example may be used in another example to yield a still furtherexample. Thus, it is intended that this disclosure include modificationsand variations that come within the scope of the appended claims andtheir equivalents.

Illustrative Examples of Providing Electrostatic Haptic Feedback Via aWearable Computing Device or a Handheld Computing Device

One illustrative example of the present disclosure includes anelectrostatic force (“ESF”) haptic output device attached to a surfaceof a smartwatch. For example, the ESF haptic output device is attachedto a band of the smartwatch.

In the illustrative example, the user wears the smartwatch around theuser's wrist and the ESF haptic output device contacts the user's skin.The ESF haptic output device includes several components that allow theESF haptic output device to output a haptic effect (e.g., textures,vibrations, change in perceived coefficient of friction, strokingsensations, and/or stinging sensations) that can be perceived by theuser. For example, the ESF haptic output device includes a conductivelayer and an insulation layer that is attached to the conductive layer.The conductive layer is electrically connected to a voltage supply thatprovides an amount of voltage to the conductive layer, which the usercan perceive as a vibration when the user is wearing the smartwatch orif the user touches the band of the smartwatch. The insulation layer ispositioned between the conductive layer and the user's skin and includesmaterial that electrically insulates the user from the voltage toprevent the user from being shocked.

In this illustrative example, a ground electrode that includes aconductive layer can also be attached to the band of the smartwatch. Theground electrode can be positioned on the band to contact the user ofthe smartwatch (e.g., when the user is wearing the smartwatch). Theground electrode may amplify or increase a perceived strength of thehaptic effect output by the ESF haptic output device.

In this illustrative example, the smartwatch is able to provide hapticeffects to the user through the ESF haptic output device by sendingsignals of various magnitudes or durations to the ESF haptic outputdevice. For example, the user receives an e-mail via the user'ssmartphone, which is connected to the smartwatch (e.g., via Bluetooth).The smartphone sends the e-mail to the smartwatch and the smartwatchoutputs a haptic effect (e.g., a vibration) to the user via the ESFhaptic output device to notify the user of the e-mail. The smartwatchalso displays the e-mail on a display screen of the smartwatch. Thesmartwatch can initially output the haptic effect at one location on theband, but the smartwatch can subsequently output the haptic effect atvarious locations on the band, such as to imitate a countdown timer andindicate to the user that the e-mail will be displayed on the displayscreen for a period of time. For example, the haptic effects canindicate to the user that the e-mail will be displayed on the displayscreen for a short period of time (e.g., one second, five seconds,etc.), a longer period of time (e.g., fifteen seconds, thirty seconds,etc.), or any other length of time. In response to receiving thenotification, the user can touch the display screen to view the e-mailor to receive information about the e-mail. For example, the user canslide a finger across the display screen and the smartwatch outputs ahaptic effect (e.g., a rough texture) to indicate to the user that thee-mail is urgent. In this illustrative example, if the user does nottouch the display screen within the period of time, the smartwatch candiscontinue the haptic effect and stop displaying the e-mail. In theillustrative example, the ESF haptic output device can include one ormore ESF haptic output devices, each of which can be attached to variousparts of the smartwatch (e.g., a face or band of the smartwatch) andused to output various haptic effects.

These illustrative examples are given to introduce the reader to thegeneral subject matter discussed here and are not intended to limit thescope of the disclosure. The following sections describe variousadditional features and examples with reference to the drawings in whichlike numerals indicate like elements, and directional descriptions areused to describe the illustrative examples but, like the illustrativeexamples, do not limit the present disclosure.

Illustrative Systems for Providing Electrostatic Haptic Feedback Via aWearable Computing Device or a Handheld Computing Device

FIG. 1 is a block diagram showing a system 100 for providingelectrostatic haptic feedback via a wearable computing device or ahandheld computing device according to one example. In the exampledepicted in FIG. 1, the system 100 includes a computing device 101having a processor 102 in communication with other hardware via a bus106. The computing device 101 may include, for example, a wearabledevice (e.g., a smartwatch, a ring, a wristband, bracelet, headband,hat, etc.), a handheld device (e.g., a tablet, video game controller), amobile device (e.g., a smartphone), etc.

A memory 104, which can include any suitable tangible (andnon-transitory) computer-readable medium such as RAM, ROM, EEPROM, orthe like, embodies program components that configure operation of thecomputing device 101. In the example shown, computing device 101 furtherincludes one or more network interface devices 110, input/output (I/O)interface components 112, and storage 114.

Network interface device 110 can represent one or more of any componentsthat facilitate a network connection. Examples include, but are notlimited to, wired network interfaces such as Ethernet, USB, IEEE 1394,and/or wireless interfaces such as IEEE 802.11, Bluetooth, or radiointerfaces for accessing cellular telephone networks (e.g.,transceiver/antenna for accessing a CDMA, GSM, UMTS, or other mobilecommunications network). Further, while referred to as a “network”device, the network interface device 110 may allow for peer-to-peerconnections with other devices, such as via Bluetooth, RFID, orNFC-style communications.

I/O components 112 may be used to facilitate wired or wirelessconnection to peripheral devices such as one or more displays 134, touchsensitive surfaces 116, game controllers, keyboards, mice, joysticks,cameras, buttons, speakers, microphones and/or other hardware used toinput or output data. Storage 114 represents nonvolatile storage such asmagnetic, optical, or other storage media included in computing device101 or coupled to the processor 102.

In some examples, the computing device 101 includes one or more touchsensitive surfaces 116. Touch sensitive surface 116 represents anysurface or portion of a surface that is configured to sense tactileinput of a user. One or more touch sensors 108 are configured to detecta touch in a touch area (e.g., when an object contacts the touchsensitive surface 116) and transmit signals associated with the touch tothe processor 102. In some examples, the touch sensor 108 may beconfigured to receive user input and transmit signals associated withthe user input to the processor 102. Any suitable number, type, orarrangement of touch sensor 108 can be used. For example, resistiveand/or capacitive sensors may be embedded in touch sensitive surface 116and used to determine the location of a touch and other information,such as pressure, speed, and/or direction.

The touch sensor 108 can additionally or alternatively include othertypes of sensors. For example, optical sensors with a view of the touchsensitive surface 116 may be used to determine the touch position. Asanother example, the touch sensor 108 may include a LED (Light EmittingDiode) finger detector mounted on the side of a display. In someexamples, touch sensor 108 may be configured to detect multiple aspectsof the user interaction. For example, touch sensor 108 may detect thespeed, pressure, and direction of a user interaction, and incorporatethis information into the signal transmitted to the processor 102.

In some examples, the computing device 101 includes a touch-enableddisplay that combines a touch sensitive surface 116 and a display 134 ofthe computing device 101. The touch sensitive surface 116 may beoverlaid on the display 134 or may be one or more layers of materialabove components of the display 134. In other examples, the computingdevice 101 may display a graphical user interface that includes one ormore virtual user interface components (e.g., buttons) on thetouch-enabled display and the touch sensitive surface 116 can allowinteraction with the virtual user interface components.

In some examples, computing device 101 includes a camera 130. Althoughthe camera 130 is depicted in FIG. 1 as being internal to the computingdevice 101, in some examples, the camera 130 may be external to and incommunication with the computing device 101. As an example, the camera130 may be external to and in communication with the computing device101 via wired interfaces such as, for example, Ethernet, USB, IEEE 1394,and/or wireless interfaces such as IEEE1 802.11, Bluetooth, or radiointerfaces.

The computing device 101 can include one or more sensors 132. The sensor132 may include, for example, gyroscope, an accelerometer, a globalpositioning system (GPS) unit, a range sensor, a depth sensor, a camera,an infrared sensor, a microphone, a humidity sensor, a temperaturesensor, an ambient light sensor, biosensor, a pressure sensor, a forcesensor, a capacitive sensor, etc. In some examples, sensor 132 mayinclude one or more touch sensors configured in substantially the samemanner as touch sensor 108.

In some examples, the processor 102 may be in communication with asingle sensor 132 and, in other examples, the processor 102 may be incommunication with a plurality of sensors 132, for example, a gyroscopeand an accelerometer. The sensor 132 is configured to transmit sensorsignals to the processor 102. Further, in some examples, the sensor 132may be in communication with the haptic output device 118.

Although the example shown in FIG. 1 depicts the sensor 132 internal tothe computing device 101, in some examples, the sensor 132 is externalto the computing device 101 and in wired or wireless communication withthe computing device 101.

In the example depicted in FIG. 1, the system further includes an ESFcontroller 120, which is communicatively coupled to computing device 101and configured to receive a haptic signal from the processor 102. Insome examples, the ESF controller 120 may amplify or modify the hapticsignal to generate an ESF haptic signal or the ESF controller maydetermine the ESF haptic signal based at least in part on the hapticsignal. The ESF controller 120 is also configured to transmit the ESFhaptic signal to a haptic output device 118. The ESF haptic signal mayinclude a signal configured to cause the haptic output device 118 tooutput a haptic effect associated with the haptic signal. In someexamples, the ESF signal may include an AC signal, AC voltage, a DCsignal, or DC voltage from a power source.

In some examples, the ESF controller 120 may include one or moreoperational amplifiers, transistors, and/or other digital or analogcomponents for amplifying signals. For example, in one example, the ESFcontroller 120 may include a high-voltage amplifier. Further, in someexamples, the ESF controller 120 may include a processor, amicrocontroller, a memory, a multiplexer, a crystal oscillator, a relay,a transistor, a field programmable gate array (“FPGA”), a flip-flop,and/or other digital or analog circuitry for generating an ESF hapticsignal.

Although in the example shown in FIG. 1, the ESF controller 120 isdepicted as being internal to the computing device 101, in someexamples, the ESF controller may be external to and in communicationwith the computing device 101. The ESF controller 120 may be incommunication with the computing device 101 via wired interfaces suchas, for example, Ethernet, USB, IEEE 1394, and/or wireless interfacessuch as IEEE1 802.11, Bluetooth, or radio interfaces.

In some examples, the system 100 further includes the haptic outputdevice 118, which is communicatively coupled to the ESF controller 120.In some examples, the haptic output device 118 can be coupled to asurface associated with the computing device 101. For example, thehaptic output device 118 can be coupled to the touch sensitive surface116 of the computing device 101. The haptic output device 118 isconfigured to receive an ESF haptic signal (e.g., from the ESFcontroller 120) and output a haptic effect that can be sensed orperceived by a user (e.g., a user of the computing device 101). In someexamples, the haptic output device 118 uses electrostatic attraction tooutput an ESF haptic effect to the user.

The ESF haptic effect can include a static ESF haptic effect. A staticESF haptic effect can include a haptic effect output by the hapticoutput device 118 that can be perceived by a user upon the user being incontact with the surface associated with the computing device 101 towhich the haptic output device 118 is coupled. For example, the user mayperceive the static ESF haptic effect when the user's skin is inconstant contact with the haptic output device 118 or with the surfaceto which the haptic output device 118 is coupled. As an example, theuser may perceive the static ESF haptic effect when the surfaceassociated with the haptic output device 118 is in continuous contactwith the user's skin. As another example, the user may perceive thestatic ESF haptic effect when the surface associated with the hapticoutput device 118 is in contact with the user's skin over a period oftime such as, for example, five seconds, ten seconds, thirty seconds, orany length of time.

In some examples, the ESF haptic effect can include a dynamic ESF hapticeffect. A dynamic ESF haptic effect includes a haptic effect that isperceived by a user upon the user sliding a body part (e.g., hand orfinger) or an object (e.g., a stylus) along a surface associated withthe haptic output device 118. For example, the user may perceive thedynamic ESF haptic effect as the user slides a finger across a surfaceof the touch sensitive surface 116. In some examples, the ESF hapticeffect output by the haptic output device 118 may include a simulatedtexture, a simulated vibration, a stroking sensation, or a perceivedchange in a coefficient of friction on a surface associated with thecomputing device 101 (e.g., the touch sensitive surface 116).

The haptic output device 118 may include an electrostatic actuator or asignal electrode, which includes a conductive layer and an insulatinglayer. For example, FIG. 2 shows an example of a haptic output devicefor providing electrostatic haptic feedback via a wearable or handhelddevice according to one example.

In the example depicted in FIG. 2, the haptic output device 118 includesa signal electrode 200 comprising an insulating layer 202 and aconductive layer 204 coupled to the insulating layer 202. In someexamples, the insulating layer 202 may be glass, porcelain, plastic,polymer, fiberglass, nitrogen, sulfur hexafluoride, or any otherinsulating material. In some examples, the insulating layer 202 may beflexible. In some examples, the insulating layer 202 may include adielectric material or a transparent material. Further, in someexamples, the insulating layer 202 is configured to directly contact auser's skin (e.g., a user of the computing device 101 of FIG. 1) or maybe configured such that the user can touch the insulating layer 202(e.g., using a hand, finger, or object). In other examples, a material(e.g., a touch sensitive surface, a computing device housing, a fluid orgel, or an adhesive) may be positioned between the insulating layer 202and the user's skin to improve the contact between the signal electrode200 and the user's skin.

The conductive layer 204 can include any semiconductor or otherconductive material, including, for example, copper, tin, iron,aluminum, gold, silver, or carbon nanotubes. In some examples, theconductive layer 204 may be flexible and/or may be transparent.

In some examples, a computing device (e.g., the computing device 101 ofFIG. 1) may operate the haptic output device 118 that includes thesignal electrode 200 by applying an electric signal having a voltage tothe conductive layer 204, which may induce an electric charge on theconductive layer 204. The electric signal may be an AC signal. In someexamples, a high-voltage amplifier may generate the AC signal.

For example, the computing device may transmit a haptic signal to an ESFcontroller (e.g., the ESF controller 120 of FIG. 1), which may outputone or more electric signals (e.g., ESF haptic signals) to theconductive layer 204 to induce an electric charge on the conductivelayer 204. The electric charge can create capacitive coupling betweenthe conductive layer 204 and an object near or touching the signalelectrode 200, for example, a user's body part, or a stylus. In such anexample, the capacitive coupling may produce attractive forces betweenthe parts of the body or the object near the signal electrode 200, whichstimulate nerve endings in the skin of the user's body, for example, theuser's finger. This stimulation may allow the user to perceive an ESFhaptic effect (e.g., the capacitive coupling) as a vibration or othersensation. In such examples, the insulating layer 202 can electricallyinsulate the user from the electric charge to prevent the user frombeing electrocuted.

In some examples, varying the level of attraction between the object andthe conductive layer 204 may vary the ESF haptic effect felt by the user(e.g., the electric charge induced on the conductive layer 204 may bevaried to create various vibrations, stroking sensations, or otherhaptic effects). For example, a low voltage electric signal (e.g., anelectric signal having a minimum voltage of approximately 100V) may beused to provide a dynamic ESF haptic effect (e.g., a change in friction)to a user as the user slides a finger across a surface associated withthe computing device (e.g., the touch sensitive surface 116 of FIG. 1).As an example, an electric signal having a voltage of 100V, 220V, 300V,etc., may be used to provide the dynamic ESF haptic effect to the useras the user slides a finger across a surface associated with thecomputing device. In some examples, any suitable electric signal may beused to provide the dynamic ESF haptic effect to the user. As anotherexample, a high voltage electric signal (e.g., an electric signal havinga minimum voltage of approximately 1.5 kV or any suitable high voltageelectric signal) may be used to provide a static ESF haptic effect(e.g., a vibration) to the user. For example, an electric signal havinga voltage of 1500V, 2000V, etc., may be used to provide the static ESFhaptic effect to the user. In some examples, the user may perceive thestatic ESF haptic effect without having to move a body part across thesurface associated with the computing device. Thus, in some examples, anelectric signal having a voltage of approximately 1.5 kV or more can beused to provide static ESF haptic effects or dynamic ESF haptic effectsto the user. In another example, an electric signal having a voltagethat is more than 100V but less than 1.5 kV may be used to provide adynamic ESF haptic effect to the user, but may be insufficient forproviding a static ESF haptic effect to the user.

In some examples, the strength of the haptic effect perceived by a usermay be based on a magnitude of the voltage of the electrical signal. Forexample, a user may perceive a haptic effect generated from an electricsignal of 1000V stronger than a haptic effect generated from an electricsignal of 100V.

Referring back to FIG. 1, in some examples, the haptic output device 118may include an ESF haptic output device as described above, as well asone or more other haptic output devices. For example, the haptic outputdevice 118 may include one or more of a piezoelectric actuator, anelectric motor, an electro-magnetic actuator, a voice coil, a shapememory alloy, an electro-active polymer, a solenoid, an ERM, or a linearresonant actuator (“LRA”). Further, in some examples, some hapticeffects may utilize an actuator coupled to a housing of the computingdevice 101, and some haptic effects may use multiple haptic outputdevices of the same or different types in sequence and/or in concert.

In still another example, the haptic output device 118 may additionallyinclude a multifunction haptic output device. The multifunction hapticoutput device can include a single haptic output device (e.g., a singlehaptic actuator) configured to output at least two different classes ofhaptic effects. As used herein, a haptic effect class comprises one ormore haptic effects distinguished by the physical principle(s) used togenerate the haptic effects (e.g., rather than the characteristics ofthe haptic effects actually perceived by a user). For example, a hapticeffect class may comprise electrostatic haptic effects (e.g., hapticeffects that may rely on electrostatic interactions between a hapticoutput device and a user to generate haptic effects). Another hapticeffect class may comprise vibrotactile haptic effects (e.g., which mayrely on mechanical vibrations to generate haptic effects). Still anotherhaptic effect class may comprise deformation haptic effects (e.g., whichmay rely on physically changing a shape of a surface to generate hapticeffects). Yet another haptic effect class may comprise temperature-basedhaptic effects (e.g., which may rely on changing a temperature of asurface contacted by a user). Still another haptic effect class maycomprise electro-tactile haptic effects (e.g., which may rely ontransmitting a current or voltage to a skin surface of a user). Themultifunction haptic output device may be configured to output any oneclass of haptic effects or any combination of classes of haptic effectsin response to a haptic signal.

Although in FIG. 1 a single haptic output device 118 is shown, in someexamples, multiple haptic output devices 118 of the same or differenttype can be used to provide haptic effects. Further, in some examples,the haptic output device 118 is in communication with the processor 102and within a housing of the computing device 101. In other examples, thehaptic output device 118 is external to the computing device 101 and incommunication with the computing device 101 (e.g., via wired interfacessuch as Ethernet, USB, IEEE 1394, and/or wireless interfaces such asIEEE 802.11, Bluetooth, or radio interfaces). For example, the hapticoutput device 118 may be associated with (e.g., coupled to) a wearabledevice (e.g., a wristband, bracelet, hat, headband, etc.) or a handhelddevice (e.g., a mobile phone, smartphone, gaming device, personaldigital assistant, etc.) and configured to receive haptic signals fromthe processor 102.

The processor 102 can execute one or more operations for operating thecomputing device 101. For example, the processor 102 can executeprocessor executable instructions 124 stored in the memory 104 toperform the operations. Non-limiting examples of the processor 102include a Field-Programmable Gate Array (“FPGA”), anapplication-specific integrated circuit (“ASIC”), a microprocessor, adigital signal processor (“DSP”), etc. The processor 102 can furtherinclude programmable electronic devices such as PLCs, programmableinterrupt controllers (“PICs”), programmable logic devices (“PLDs”),programmable read-only memories (“PROMs”), electronically programmableread-only memories (“EPROMs” or “EEPROMs”), or other similar devices.

In some examples, processor executable instructions 124 can configurethe processor 102 to monitor the touch sensitive surface 116 via thetouch sensor 108 to determine a position of a touch. For example,processor executable instructions 124 may cause the processor 102 tosample the touch sensor 108 in order to track the presence or absence ofa touch and, if a touch is present, to track one or more of thelocation, path, velocity, acceleration, pressure and/or othercharacteristics of the touch over time. Processor executableinstructions 124 can also cause the processor 102 to receive sensorsignals from the touch sensor 108, which can correspond to the presenceor absence of a touch or the location, path, velocity, acceleration,pressure, or other characteristic of the touch.

Processor executable instructions 124 can also configure the processor102 to provide content (e.g., texts, images, sounds, videos, etc.) to auser (e.g., to a user of the computing device 101). As an example,processor executable instructions 124 can configure the processor 102 toprovide an image in any format (e.g., in an animated graphicsinterchange format) to the user. If the content includes computergenerated images, the processor 102 is configured to generate the imagesfor display on a display device (e.g., the display 134 of the computingdevice or another display communicatively coupled to the processor 102).If the content includes video and/or still images, the processor 102 isconfigured to access the video and/or still images and generate views ofthe video and/or still images for display on the display device. If thecontent includes audio content, the processor 102 is configured togenerate electronic signals that will drive a speaker, which may be partof the display device, to output corresponding sounds. In some examples,processor executable instructions 124 can cause the processor 102 toobtain the content, or the information from which the content isderived, from the storage 114, which may be part of the computing device101, as illustrated in FIG. 1, or may be separate from the computingdevice 101 and communicatively coupled to the computing device 101. Insome examples, processor executable instructions 124 can cause theprocessor 102 to receive content from or transmit content to anotherdevice.

Processor executable instructions 124 may configure the processor 102 toanalyze data to determine or select a haptic effect to generate.Particularly, processor executable instructions 124 may include codethat causes the processor 102 to determine a haptic effect to output tothe user. In some examples, processor executable instructions 124 maycause the processor 102 to access a look up table that includes datacorresponding to various haptic effects. In some examples, the look uptable may also include data corresponding to one or more eventsassociated with each haptic effect. The processor executableinstructions 124 can cause the processor 102 to access the lookup tableand select one or more haptic effects included in the lookup table. Insome examples, the haptic effect may include an electrostatic hapticeffect. The electrostatic haptic effect can include a static ESF hapticeffect or a dynamic ESF haptic effect. Determining the haptic effect mayinclude determining the type of haptic effect and one or more parametersof the haptic effect, such as amplitude, frequency, duration, etc.

In some examples, processor executable instructions 124 can cause theprocessor 102 to use sensor signals (e.g., received by the processor 102from the touch sensor 108) to select a haptic effect from a lookuptable. For example, the sensor signals can indicate that a user is inconstant contact with the touch sensitive surface 116. As an example,the sensor signals can indicate that the user's skin is touching thetouch sensitive surface 116 over a period of time such as, for example,five seconds, ten seconds, twenty seconds, or any other length of time.The processor executable instructions 124 can cause the processor 102 toaccess a lookup table that includes data corresponding to an event orsensor signal, along with data indicating one or more haptic effectsassociated with each event or sensor signal. The processor 102 canselect from the lookup table a haptic effect that corresponds to a userbeing in constant contact with the touch sensitive surface and selectthe haptic effect. Further, processor executable instructions 124 mayinclude code that causes the processor 102 to select one or more hapticeffects to provide, and/or one or more haptic output devices 118 toactuate, in order to generate or output the haptic effect. For example,a sensor signal can indicate a location of a user's touch on the touchsensitive surface 116 and the processor 102 can access a lookup tablethat includes data corresponding to various haptic effects, along withdata corresponding to various haptic output devices for outputting eachhaptic effect and a location of each haptic output device. The processor102 can select a haptic effect or a haptic output device 118 from thelookup table to output the haptic effect based on the location of thelocation of the user's touch. As an example, the processor executableinstructions 124 can cause the processor 102 to actuate a haptic outputdevice 118 that is located at the location of the user's touch.

In some examples, some or all of the area of the touch sensitive surface116 may be mapped to a graphical user interface (“GUI”), for example, aGUI output on display 134. The processor executable instructions 124 maycause the processor 102 to select various haptic effects based on alocation of a touch in order to output the haptic effect. As an example,a user may interact with the GUI via touch sensitive surface 116 (e.g.,by tapping or making a gesture, such as a two-finger pinch or one-fingerscroll, on the touch sensitive surface 116), the processor 102 mayaccess a lookup table or database that includes data corresponding tovarious haptic effects, along with data indicating correspondinginteractions or locations of interactions and select different hapticeffects based on the location of the interaction.

Processor executable instructions 124 may include code that causes theprocessor 102 to determine a haptic effect based on an event. An event,as used herein, includes any interaction, action, collision, or otherevent which occurs during operation of the computing device 101, whichcan potentially include an associated haptic effect. In some examples,an event may include user input (e.g., a button press, manipulating ajoystick, interacting with a touch sensitive surface 116, tilting ororienting the device), a system status (e.g., low battery, low memory,or a system notification, such as a notification generated based on thesystem receiving a message, an incoming phone call, a notification, oran update), sending data, receiving data, or a program event (e.g., ifthe program is a game, a program event may include explosions, gunshots,collisions, interactions between game characters, advancing to a newlevel, driving over bumpy terrain, etc.). For example, the computingdevice 101 can receive an e-mail from another computing device (e.g.,via network interface device 110) and generate a notification based onthe received e-mail. The processor 102 can access a look up table thatincludes various haptic effects and select a haptic effect thatcorresponds to a received e-mail.

In some examples, the processor executable instructions 124 may causethe processor 102 to determine a haptic effect based at least in part onsensor signals received from the touch sensor 108 or sensor 132. Forexample, the touch sensor 108 can detect a touch of an object (e.g., theskin of a user on the computing device 101 or a stylus) on a surfaceassociated with the computing device 101 (e.g., the touch sensitivesurface 116) and transmit a sensor signal to the processor 102 inresponse to detecting the touch. The processor 102 can determine thatthe object is touching the surface based on the sensor signal. Theprocessor executable instructions 124 may cause the processor to accessa lookup table or database that includes data corresponding to varioussensor signals, along with data indicating one or more haptic effectsassociated with each sensor signal and select one or more haptic effectsbased on the object touching the surface. In some examples, theprocessor 102 can receive multiple sensor signals over a period of timeand determine that the object is in constant contact with the surface.For example, the processor 102 can receive multiple sensor signals overa short period of time (e.g., two seconds, five seconds, etc.), a longerperiod of time (e.g., ten seconds, fifteen seconds, etc.) or any otherlength of time and determine that the object is in constant contact withthe surface. As an example, the touch sensor 108 may detect the touch ofthe object over the period of time and periodically (e.g., fivemilliseconds, 10 milliseconds, etc.) transmit a sensor signal thatindicates that a touch is detected to the processor 102 and theprocessor 102 can determine that the object is in constant contact withthe surface based on the sensor signals. The processor executableinstructions 124 may cause the processor to access the lookup table ordatabase and select one or more haptic effects based on the object beingin constant contact with the surface.

The processor executable instructions 124 may also cause the processor102 to determine a haptic effect in response to an event as describedabove and in response to determining that the object is constantlytouching the surface. For example, the computing device 101 can be asmartwatch worn by a user and the touch sensor 108 can be attached to asurface of a band of the smartwatch. The touch sensor 108 can detectcontact between the user's skin and the surface of the band. Thecomputing device 101 can receive an e-mail from another computing deviceand one or more sensor signals from touch sensor 108 and determine thatthe object is in constant contact with the surface based on the sensorsignals. The processor executable instructions 124 can cause theprocessor 102 to access one or more lookup tables that include datacorresponding to an event or a sensor signal, along with data indicatingone or more haptic effects associated with each event and sensor signal.The processor 102 can select an electrostatic haptic effect (e.g., astatic ESF haptic effect) from the lookup table based on the computingdevice 101 receiving the e-mail and the object being in constant contactwith the surface. In some examples, the electrostatic haptic effect canbe output to the user to indicate to the user that the computing device101 has received the e-mail and the user can perceive the electrostatichaptic effect.

In some examples, the processor 102 may receive sensor signals from thetouch sensor 108 and determine a track, path, velocity, acceleration,pressure, or other characteristic of an object touching the surface towhich the haptic output device 118 is attached. In such an example,processor executable instructions 124 may cause the processor todetermine another haptic effect based at least in part on the determinedtrack, path, velocity, acceleration, or pressure. For example, processorexecutable instructions 124 can cause the processor 102 to selectanother electrostatic haptic effect (e.g., a dynamic ESF haptic effect)based on the track, path, velocity, acceleration, or pressure of theobject, which can be output to the user to provide information to theuser.

As an example, the computing device 101 can be a smartwatch worn by auser and the touch sensor 108 can be coupled to a surface of a band ofthe smartwatch to detect a velocity or acceleration of a user's touchacross the surface of the band. The processor 102 can receive datacorresponding to an e-mail notification. The processor 102 also receivessensor signals from the touch sensor 108 and determines that the user issliding a finger or hand across the surface of the band (e.g., based ona velocity of the contact of the user's finger or hand on the surface ofthe band). The processor executable instructions 124 can cause theprocessor 102 to access a lookup table or database that include datacorresponding to one or more events or sensor signals, along with dataindicating one or more haptic effects associated with each event orsensor signal and the processor 102 can select a dynamic ESF hapticeffect (e.g., a smooth texture) that corresponds to the user sliding afinger or hand across the surface of the band. The dynamic ESF hapticoutput effect can be output to the surface of the band to which thehaptic output device 118 is attached such that the user perceives thedynamic ESF haptic effect as the user's finger or hand slides across thesurface of the band. As another example, haptic effects may be selectedbased on the acceleration of the object (e.g., a strong vibration if theacceleration of the user's finger sliding across the surface is high ora weaker vibration if the acceleration is low).

In some examples, the processor executable instructions 124 can causethe processor to determine a haptic effect configured to provide a userwith information. For example, the processor executable instructions 124may cause the processor 102 to determine a haptic effect that may beconfigured to communicate information to the user (e.g., that the userhas a missed phone call, text message, e-mail, instant message, a levelof urgency associated with a missed phone call, text message, e-mail,and/or other communication). For example, the processor executableinstructions 124 can cause the processor 102 to access a lookup table ordatabase that includes data corresponding to a type of information to becommunicated to the user, along with data indicating one or more hapticeffects associated with the type of information. The processor 102 canselect a dynamic ESF haptic effect (e.g., a smooth texture) to be outputto the surface of the band of the smartwatch to which the haptic outputdevice 118 is attached such that the user perceives the dynamic ESFhaptic effect as the user's finger or hand slides across the touchsensitive portion, which may indicate a level of urgency of the e-mailnotification (e.g., that the e-mail is not very urgent).

In some examples, the processor executable instructions 124 may includecode that causes the processor 102 to determine, based on a location ofa touch on the touch sensitive surface 116, a haptic effect to outputand code that causes the processor 102 to select one or more hapticeffects to provide in order to simulate the effect. For example, theprocessor 102 can access a lookup table or database that includes datacorresponding to various locations on the touch sensitive surface 116,along with data indicating a corresponding haptic effect for eachlocation. The processor 102 can select different haptic effects based onthe location of a touch in order to simulate the presence of a virtualobject (e.g., a virtual piece of furniture, automobile, animal, cartooncharacter, button, lever, logo, or person) on the display 134. Further,in some examples, processor executable instructions 124 may include codethat causes the processor 102 to determine, based on the size, color,location, movement, and/or other characteristics of a virtual object, ahaptic effect to output and code that causes the processor 102 to selectone or more haptic effects to provide in order to simulate the effect.For example, haptic effects may be selected based on the size of avirtual object (e.g., a strong vibration if the virtual object is large,and a weaker vibration if the virtual object is small). In suchexamples, the haptic effects may include one or more of an electrostatichaptic effect, a vibrotactile haptic effect, a deformation hapticeffect, a temperature-based haptic effect, or an electro-tactile hapticeffect.

The processor executable instructions 124 may also include programmingthat causes the processor 102 to generate and transmit haptic signals tothe haptic output device 118 to generate the selected haptic effect. Insome examples, processor executable instructions 124 causes the hapticoutput device 118 to generate a haptic effect determined by theprocessor 102. For example, the processor executable instructions 124may cause the processor 102 to access stored waveforms or commands tosend to the haptic output device 118 to create the selected hapticeffect. For example, the processor executable instructions 124 can causethe processor 102 to access a lookup table that includes data indicatingone or more haptic signals associated with one or more haptic effectsand determine a waveform to transmit to haptic output device 118 togenerate a particular haptic effect. In some examples, the processorexecutable instructions 124 may include algorithms that can be used todetermine target coordinates for the haptic effect (e.g., coordinatesfor a location on the computing device 101, such as on the touchsensitive surface 116, at which to output the haptic effect). Forexample, the processor executable instructions 124 may cause theprocessor 102 to use a sensor signal indicating a location of a touch ofan object on the touch sensitive surface 116 to determine targetcoordinates for the haptic effect, which may correspond to the locationof the touch.

FIG. 3 shows an example of a system for providing electrostatic hapticfeedback via a wearable device. In the example shown in FIG. 3, thesystem includes a computing device 300 that is a wearable device (e.g.,a smartwatch). In some examples, haptic output devices 118 a-b arecoupled to a surface 302, 304 associated with the computing device 300.For example the haptic output device 118 a can be glued, stitched, ortaped to the surface 302 (e.g., a band of the smart watch). As anotherexample, a conductive layer of the haptic output device 118 b (e.g., theconductive layer 204 of FIG. 2) can be deposited on the surface 304. Forexample, conductive paint that includes the conductive layer can bedeposited on the surface 304. In such examples, an insulating layer ofthe haptic output device 118 b (e.g., the insulating layer 202 of FIG.2) can be deposited or positioned on or proximate to the conductivelayer or on the surface 304 such that the insulating layer covers theconductive layer.

The haptic output devices 118 a-b can be embedded within the computingdevice 300 or surface 302, 304 associated with the computing device 300.For example, the haptic output device 118 a can be embedded within thesurface 302 (e.g., embedded within a band of a smartwatch). As anotherexample, the haptic output device 118 b can be embedded within an outercasing and/or housing of the computing device 300.

In some examples, the haptic output device 118 a-b can include at leasta portion of the computing device 300. For example, a conductive layerof the haptic output device 118 a can include a portion of the surface302 (e.g., include a portion of the band of the smartwatch) and aninsulating layer of the haptic output device 118 a can be positioned onor proximate to the conductive layer to cover the conductive layer.

In some examples, a ground electrode 306 may also be coupled to thecomputing device 300. For example, the ground electrode 306 may becoupled to a surface 308 associated with the computing device 300 (e.g.,a band of the smartwatch) or any surface associated with the computingdevice 300 (e.g., surface 302, 304). A ground electrode may include aground electrode conductive layer, which can be configured insubstantially the same manner as conductive layer 204 of FIG. 2.

In some examples, a gel or liquid can be coupled to the groundconductive layer (e.g., positioned on or proximate to the groundconductive layer). In some examples, the gel or liquid can be aconductive gel or a conductive liquid. In such examples, the groundelectrode may include the gel or liquid. In other examples, the gel orliquid may be formed on the ground conductive layer. As an example, thegel or liquid may be formed by a chemical reaction when the computingdevice 300 is worn or held by a user and may become coupled to theground electrode conductive layer as the gel or liquid is formed. Asanother example, the computing device 300 may include a dispensingdevice (e.g., a pump) configured to form and/or dispense the gel orliquid on or proximate to the ground electrode conductive layer suchthat the gel or liquid becomes coupled to the ground electrodeconductive layer. In some examples, the ground electrode may include agel pad that includes the ground conductive layer and the gel or liquidcoupled to the ground conductive layer. In some examples, the groundelectrode 306 may include a ground electrode insulating layer, which maybe configured in substantially the same manner as insulating layer 202of FIG. 2 and may be coupled to the ground electrode conductive layer.In some examples, the ground electrode 306 may not include a gel orliquid and the ground electrode insulating layer may be coupled to theground electrode conductive layer. In some examples, coupling the groundelectrode 306 to the computing device 300 may amplify or increase aperceived strength of an ESF haptic effect (e.g., a static ESF hapticeffect or a dynamic ESF haptic effect) output by the haptic outputdevices 118 a-b.

Although the example depicted in FIG. 3 shows a ground electrode 306coupled to the computing device 300, in some examples, the groundelectrode 306 may not be coupled to the computing device 300 (e.g., thecomputing device 300 may not include a ground electrode 306). Further,although two haptic output devices 118 a-b are shown in FIG. 3, someexamples may use any number of haptic output devices 118 positioned onor coupled to a surface associated with the computing device 300.

In some examples, a haptic output device can be coupled to a surfaceassociated with the computing device 300 and configured to output an ESFhaptic effect to the surface. For example, FIGS. 4A-B show anotherexample of a system for providing electrostatic haptic feedback via awearable device according to one example. In the example depicted inFIGS. 4A-B, haptic output devices 400 a-b are coupled to surfacesassociated with the computing device 402, which is a smartwatch. In thisexample, haptic output device 400 a is coupled to a first surface of thecomputing device 402 (e.g., the bottom of a casing of the smartwatch)and haptic output device 400 b is coupled to a second surface of thecomputing device 402 (e.g., a side of the casing of the smartwatch). Insome examples, the haptic output device 400 a can be coupled to thefirst surface of the computing device 402 such that the skin of a userof the computing device 402 can be in constant contact with the hapticoutput device 400 a. For example, coupling the haptic output device 400a to the bottom of a casing of the smartwatch may allow the hapticoutput device 400 a to be in constant contact with the skin of a userwearing the smartwatch. In some examples, the haptic output device 400 bcan be coupled to the second surface of the computing device 402 suchthat a user of the computing device 402 can contact the haptic outputdevice 400 b. As an example, the haptic output device 400 b can becoupled to the side of the casing of the smartwatch such that a user ofthe smartwatch can touch the haptic output device 400 b with the user'shand, finger 404, or an object (e.g., a stylus).

The haptic output devices 400 a-b can output a haptic effect, which canbe perceived by a user of the computing device 402. For instance, hapticoutput device 400 a can output a static ESF haptic effect (e.g., avibration) to the first surface of the computing device 402 in responseto an event (e.g., an incoming call) and the user may perceive thestatic ESF haptic effect when the user is in constant contact with thefirst surface (e.g., when the user is wearing the computing device 402).As another example, haptic output device 400 b can output a dynamic ESFhaptic effect (e.g., a simulated texture) to the second surface and theuser may perceive the dynamic ESF haptic effect when the user slides afinger 404 across the second surface. In some examples, the hapticoutput device 400 b can output the dynamic ESF haptic effect to indicateor communicate information to the user of the computing device 400. Forexample, the haptic output device 400 a outputs a static ESF hapticeffect (e.g., a vibration) to the first surface in response to anotification (e.g., an e-mail notification) and the user may slide afinger 404 across the second surface and haptic output device 400 b canoutput a dynamic ESF haptic effect (e.g., a smooth texture), which mayindicate to the user that the e-mail notification is not urgent. In someexamples, the haptic output device 400 b can also output a static ESFhaptic effect. In another example, each of the haptic output devices 400a-b can output a static ESF haptic effect or a dynamic ESF hapticeffect. In still another example, the haptic output devices 400 a-b canbe combined to form a single haptic output device that can output staticESF haptic effects or dynamic ESF haptic effects.

In some examples, the computing device 402 may include a sensor (e.g.,touch sensor 108) and the haptic output devices 400 a-b can output ahaptic effect based on sensor signals. For example, the sensor maydetect an object (e.g., a user's skin, finger, hand, or a stylus)touching a surface associated with the computing device and transmitsensor signals associated with the touch to a processor associated withthe computing device 402 (e.g., the processor 102 of FIG. 1). The sensorsignal can correspond to an amount of pressure, a location, a velocity,or an acceleration of the touch. The computing device 402 may determineand output one or more haptic effects (e.g., via the haptic outputdevices 400 a-b) based at least in part on the sensor signals. Forexample, the computing device 402 may receive sensor signals anddetermine that the object is not moving (e.g., when the user is wearingthe computing device 402 and the user's skin is in constant contact witha surface associated with the computing device 402). The computingdevice 402 may output a static ESF haptic effect (e.g., a vibration viahaptic output device 400 a) to a body part of the user in response to anevent (e.g., an incoming call) and in response to determining that theobject is not moving and the user may perceive the static ESF hapticeffect. As another example, the computing device 402 may receive sensorsignals and determine that the object is moving (e.g., when a user issliding a finger 404 or a stylus across a surface associated with thecomputing device 402). The computing device 402 may output a dynamic ESFhaptic effect (e.g., a simulated texture or a perceived coefficient offriction) in response to determining that the object is moving and thedynamic ESF haptic effect may be used to communicate information to theuser as described above.

Although, two haptic output devices 400 a-b are shown in FIG. 4, someexamples may use fewer or more haptic output devices of the same ordifferent type, in series or in concert, to produce haptic effects. Forexample, FIG. 5 shows another example of a system for providingelectrostatic haptic feedback via a wearable device according to oneexample. In the example depicted in FIG. 5, a haptic output device 500is attached to a surface of a wearable device 502. The haptic outputdevice 500 can be configured to output a static ESF haptic effect that auser of the wearable device 502 may perceive when the user's skin is inconstant contact with the haptic output device 500. In this example, thehaptic output device 500 can also be configured to output a dynamic ESFhaptic effect that can be perceived by the user when the user slides anobject (e.g., a hand, finger, or stylus) across the surface of thewearable device 502 to which the haptic output device 500 is attached.

In some examples, a haptic output device can be coupled to a handhelddevice for providing electrostatic haptic feedback. For example, FIG. 6shows an example of a system for providing electrostatic haptic feedbackvia a handheld device according to one example. In the example depictedin FIG. 6, a handheld device 600 may include a device that can be heldor grasped (e.g., by a user). For example, in some examples, thehandheld device 600 may include a game system controller, a steeringwheel, a mobile device, a tablet, an e-reader, a laptop, a game-pad, ajoystick, a button, a stylus, a remote control, a mouse, a keyboard,etc. The handheld device 600 may be a standalone device or may becommunicatively coupled to another device (e.g., a video game system).In some examples, the handheld device 600 may be configured such thatthe handheld device 600 can contact portion of a user's hand, forexample, the user's fingertips, palm, fingers, etc. In some examples, ahaptic output device may be coupled to a surface associated with thehandheld device 600 (e.g., on a button or surface of the handhelddevice, embedded within the handheld device 600, include a portion of ahousing and/or casing of the handheld device 600, etc.) to output ahaptic effect that may be perceived by the user.

The handheld device 600 may include one or more sensors (e.g., touchsensor 108 or sensor 132). For example, in some examples, the entiresurface or apportion of the surface associated with the handheld device600 may include one or more sensors. In some examples, the handhelddevice 600 can output haptic effects via the haptic output devicecoupled to the surface associated with the handheld device 600 based atleast in part on signals from the sensors. For example, sensor signalsmay indicate that a user is contacting a portion of the surface of thehandheld device 600. In some examples, the handheld device 600 mayoutput a static ESF haptic effect in response to an event (e.g., anevent in a video game being played by the user via the handheld device600) and the user can perceive the static ESF haptic effect as a changein the perceived coefficient of friction, a simulated vibration, or asimulated texture at the user's fingertip or palm as the user grasps ormanipulates the handheld device 600.

In some examples, sensor signals may correspond to an amount ofpressure, direction, velocity, or acceleration of the user's contactwith the portion of the surface of the handheld device 600 to which thehaptic output device is coupled. In some examples, the handheld device600 may output a dynamic ESF haptic effect (e.g., perceived coefficientof friction or a simulated texture) based on the pressure, direction,velocity, or acceleration of the user's contact. For example, thehandheld device 600 may output the dynamic ESF haptic effect in responseto determining that the user is sliding a finger across a portion of thesurface of the handheld device 600 and the dynamic ESF haptic effect maycommunicate information to the user (e.g., provide the user withinformation associated with a video game being played by the user viathe handheld device 600).

Illustrative Methods for Providing Electrostatic Haptic Feedback Via aWearable Computing Device or a Handheld Computing Device

FIG. 7 is a flow chart of steps for performing a method for providingelectrostatic haptic feedback via a wearable or handheld deviceaccording to one example. In some examples, the steps in FIG. 7 may beimplemented in program code that is executable by a processor, forexample, the processor in a general purpose computer, a mobile device,or a server. In some examples, these steps may be implemented by a groupof processors. In some examples, one or more steps shown in FIG. 7 maybe omitted or performed in a different order. Similarly, in someexamples, additional steps not shown in FIG. 7 may also be performed.The steps below are described with reference to components describedabove with regard to the systems shown in FIGS. 1 and 3.

The method 700 begins at step 702 when a contact between an object(e.g., a user's hands, finger or skin, or a stylus) and a surface 302,304 associated with a computing device 300 is detected. In someexamples, the touch sensor 108 or sensor 132 can detect the contactbetween the object and the surface 302, 304. In some examples, the touchsensor 108 or sensor 132 may include an ambient light sensor, a pressuresensor, a force sensor, a capacitive sensor, a touch sensor, etc., fordetecting the contact.

The method continues at step 704 when a characteristic of the contactbetween the object and the surface 302, 304 is detected. In someexamples, the touch sensor 108 or sensor 132 detects the characteristicof the contact. The characteristic of the contact can include alocation, path, velocity, acceleration, pressure or othercharacteristics of the contact. For example, the touch sensor 108 candetect contact between a user's finger and the surface 302 associatedwith the computing device 300 and detect a velocity of the contact.

The method continues at step 706 when sensor signal associated with thecontact or the characteristic of the contact is transmitted. In someexamples, the touch sensor 108 or 132 transmits the sensor signal to theprocessor 102. The sensor signal can indicate a presence, absence,location, path, velocity, acceleration, pressure or other characteristicof the contact. In some examples, the sensor signal can indicate thepresence, absence, location, path, velocity, acceleration, pressure orother characteristic of the contact over a period of time (e.g., tenseconds). In some examples, the touch sensor 108 or 132 transmits thesensor signal to the processor 102 periodically over the period of time(e.g., every 10 milliseconds). The sensor signal may include an analogor a digital signal. In some examples, the sensor may only transmit asensor signal upon sensing an event, such as a touch or a movement.

The method continues at step 708 when the processor 102 determines anESF haptic effect. In some examples, the processor 102 can executeoperations to determine the ESF haptic effect. In some examples, the ESFhaptic effect can include one or more haptic effects (e.g., textures,vibrations, change in perceived coefficient of friction, strokingsensations, and/or stinging sensations). The ESF haptic effect caninclude a static ESF haptic effect or a dynamic ESF haptic effect. Insome examples, the processor 102 may determine the ESF haptic effectbased at least in part on an event, or sensor signals received from thetouch sensor 108 or sensor 132. For example, the processor 102 maydetermine the ESF haptic effect based on a text message received by thecomputing device 300). As another example, the processor 102 maydetermine the ESF haptic effect based on a sensor signal indicating thepresence, absence, location, path, velocity, acceleration, pressure orother characteristic of a contact between an object and the surface 302,304. (e.g., a sensor signal transmitted in step 706).

For example, one or more look up tables or databases can include datacorresponding to one or more events or sensor signals, along with dataindicating one or more ESF haptic effects associated with each event orsensor signal. The processor 102 can access the look up tables ordatabases to select an ESF haptic effect associated with an incomingcall notification on the computing device 300. In some examples, if asensor signal received by the processor indicates a contact between theuser's skin and the surface 304, the processor 102 can further select astatic ESF haptic effect (e.g., a simulated vibration) that isassociated with a contact between the user's skin and the surface 304.The static ESF haptic effect can be perceived by the user when theuser's skin is in constant contact with the surface 304 (e.g., when theuser is wearing the computing device 300). As another example, theprocessor 102 can receive sensor signal indicating a path, velocity, oracceleration of an object (e.g., the user's finger or a stylus)contacting the surface 302 associated with the computing device 300. Theprocessor 102 can determine that a user is sliding the object across thesurface 302 based on the sensor signal and select an ESF haptic effect(e.g., a dynamic ESF haptic effect) in response to determining that theuser is sliding the object across the surface 302.

In some examples, the processor 102 may determine the ESF haptic effectbased on activity associated with an electronic game (e.g., a gameplayed on a tablet, computer, or dedicated gaming system such as aconsole). For example, the computing device 101 is a handheld device(e.g., a video game controller) associated with the electronic game. Insome examples, the ESF haptic effect may be associated with an eventoccurring in the electronic game (e.g., a collision in the electronicgame) or the ESF haptic effect may be used to communicate information toa user. In one such example, the user may use the computing device 101to control a vehicle in the electronic game and an ESF haptic effect mayvary based on a terrain over which the vehicle is driving (e.g., the ESFhaptic effect can be an intense vibration if the terrain is rough). Asanother example, the ESF haptic effect may indicate a condition of thevehicle. For example, the ESF haptic effect may be a texture that can beperceived by the user and a roughness of the texture may vary based ondamage sustained by the vehicle. As an example, the texture may besmooth when the vehicle is undamaged, but the texture may becomeincreasingly rough based on damage to or destruction of the vehicle.

In some examples, the processor 102 may determine the ESF haptic effectbased on an event such as, for example, any interaction, action,collision, or other event which occurs during operation of the computingdevice 101, which can potentially include an associated haptic effect.In some examples, an event may include user input (e.g., a button press,manipulating a joystick, interacting with a touch sensitive surface 116,tilting or orienting the device), a system status (e.g., low battery,low memory, or a system notification, such as a notification generatedbased on the system receiving a message, an incoming phone call, anotification, or an update), sending data, receiving data, or a programevent (e.g., if the program is a game, a program event may includeexplosions, gunshots, collisions, interactions between game characters,advancing to a new level, driving over bumpy terrain, etc.). Forexample, the computing device 101 can receive an incoming call fromanother computing device and generate a notification based on theincoming call. The processor 102 can access a look up table thatincludes various haptic effects and select an ESF haptic effect thatcorresponds to an incoming call. In such examples, the processor 102 candetermine the ESF haptic effect in the absence of sensor signals (e.g.,if the computing device 101 does not include the touch sensor 108 orsensor 132).

The method 700 continues at step 710 when an ESF haptic signalassociated with the ESF haptic effect is transmitted. In some examples,the processor 102 transmits the ESF haptic signal. In some examples, theprocessor 102 transmits the ESF haptic signal to an ESF controller 120or a haptic output device 118.

The method 700 continues at step 712 when the ESF haptic signal isreceived. In some examples, the ESF controller 120 receives the ESFhaptic signal. In some examples, the ESF haptic signal may include adigital or an analog signal. In some examples, the ESF controller 120may perform analog-to-digital conversion of the ESF haptic signal. Insome examples, the ESF controller 120 may amplify, invert, or otherwisemodify the ESF haptic signal received.

In some examples, the ESF controller 120 is configured to generate ordetermine one or more static ESF haptic signals or dynamic ESF hapticsignals to be output to a haptic output device 118 based at least inpart on the ESF haptic signal, and then transmit the static ESF hapticsignal or a dynamic ESF haptic signal to the haptic output device 118.In some examples, the ESF controller 120 can amplify the haptic signalto generate the static ESF haptic signal or a dynamic ESF haptic signal.

The ESF controller 120 may include a processor or a microcontroller. Theprocessor or microcontroller may rely on programming contained in memoryto determine the static ESF haptic signal or the dynamic ESF hapticsignal to output to the haptic output device 118. In some examples, theprogramming contained in the memory may include a lookup table. In someexamples, the processor or microcontroller may use the lookup table todetermine the static ESF haptic signal or the dynamic ESF haptic signalto output based on information received in the ESF haptic signal. Forexample, the processor or microcontroller may compare informationreceived in the ESF haptic signal to information in the lookup table andselect the static ESF haptic signal or the dynamic ESF haptic signalbased on the comparison (e.g., select a static ESF haptic signal ordynamic ESF haptic signal that corresponds to the ESF haptic signal).

The method 700 continues at step 714 when an ESF haptic output device118 a-b coupled to the surface 302, 304 associated with the computingdevice 300 outputs the ESF haptic effect. In some examples, the ESFhaptic output device 118 a-b receives an ESF haptic signal and outputsthe ESF haptic effect. In some examples ESF haptic effect includes asimulated vibration, a change in a perceived coefficient of friction, ora simulated texture that can be perceived by a user of the computingdevice 300.

In some examples, the ESF haptic output device 118 a-b includes aninsulator coupled to a conductor. The ESF haptic signal includes anelectric signal that is applied to the conductor, which induces a chargein the conductor. The electric signal can be an AC signal or AC voltagethat, in some examples, may be generated by a high-voltage amplifier orany power source. In some examples, the charge on the conductor maycapacitively couple the conductor with an object near or touching theESF haptic output device 118 a-b (e.g., an object near or touching thesurface 302, 304 to which the ESF haptic output device 118 a-b iscoupled). The capacitive coupling may, in some examples, result in theuser perceiving the haptic effect.

The methods, systems, and devices discussed above are examples. Variousconfigurations may omit, substitute, or add various procedures orcomponents as appropriate. For instance, in alternative configurations,the methods may be performed in an order different from that described,and/or various stages may be added, omitted, and/or combined. Also,features described with respect to certain configurations may becombined in various other configurations. Different aspects and elementsof the configurations may be combined in a similar manner. Also,technology evolves and, thus, many of the elements are examples and donot limit the scope of the disclosure or claims.

The use of “adapted to” or “configured to” herein is meant as open andinclusive language that does not foreclose devices adapted to orconfigured to perform additional tasks or steps. Additionally, the useof “based on” is meant to be open and inclusive, in that a process,step, calculation, or other action “based on” one or more recitedconditions or values may, in practice, be based on additional conditionsor values beyond those recited. Headings, lists, and numbering includedherein are for ease of explanation only and are not meant to belimiting.

Use herein of the word “or” is intended to cover inclusive and exclusiveOR conditions. In other words, A or B or C includes any or all of thefollowing alternative combinations as appropriate for a particularusage: A alone; B alone; C alone; A and B only; A and C only; B and Conly; and A and B and C.

1-22. (canceled)
 23. A wearable device comprising: a band configured tobe secured to a user; a display device coupled to the band; a firstelectrostatic force (“ESF”) haptic output device, mechanically coupledto a first portion of a surface of the band, configured to output atleast one static ESF haptic effect, and comprising: a first conductivelayer electrically coupled to a voltage source; and a first insulationlayer disposed on the first conductive layer to prevent contact betweenthe user and the first conductive layer; and a second ESF haptic outputdevice mechanically coupled to a second portion of the surface of theband, configured to output at least one dynamic ESF haptic effectdifferent from the at least one static ESF haptic effect, andcomprising: a second conductive layer electrically coupled to thevoltage source; and a second insulation layer disposed on the secondconductive layer to prevent contact between the user and the secondconductive layer.
 24. The wearable device of claim 23, wherein thewearable device comprises a smartwatch.
 25. The wearable device of claim23, wherein the first portion and the second portion of the surface ofthe band are different locations on the band.
 26. The wearable device ofclaim 23, wherein the first portion and the second portion of thesurface of the band are both located on an outer surface of the band.27. The wearable device of claim 23, further comprising a processorcoupled to the first ESF haptic output device and the second ESF hapticoutput device and configured to: determine a first ESF haptic effect andtransmit a first ESF haptic signal to the first ESF haptic outputdevice; and determine a second ESF haptic effect and transmit a secondESF haptic signal to the second ESF haptic output device.
 28. Thewearable device of claim 27, further comprising a touch sensorconfigured to detect at least one characteristic of at least one contactand wherein the processor is configured to determine the first ESFhaptic effect based in part on the at least one characteristic.
 29. Thewearable device of claim 28, wherein the at least one characteristic ofthe at least one contact comprises at least one of a location, a path, apressure, a velocity, or an acceleration.
 30. The wearable device ofclaim 29, wherein the processor is configured to: determine the firstESF haptic effect based at least in part on the location and transmitthe first ESF haptic signal to the first ESF haptic output device; anddetermine the second ESF haptic effect based at least in part on thepressure and transmit the second ESF haptic signal to the second ESFhaptic output device.
 31. The wearable device of claim 23, furthercomprising a ground electrode coupled to an outer surface of the band,the ground electrode comprising a ground electrode conductive layer. 32.The wearable device of claim 31, wherein the ground electrode furthercomprises at least one of a ground electrode insulation layer or aconductive gel coupled to the ground electrode conductive layer.
 33. Amethod comprising: detecting at least one contact on a wearable devicecomprising a band configured to be secured to a user; determining afirst electrostatic force (“ESF”) haptic effect and a second ESF hapticeffect based at least in part on the at least one contact; transmittinga first ESF haptic signal associated with the first ESF haptic effect toa first ESF haptic output device, mechanically coupled to a firstportion of a surface of the band and configured to output at least onestatic ESF haptic effect, and comprising: a first conductive layerelectrically coupled to a voltage source; and a first insulation layerdisposed on the first conductive layer to prevent contact between theuser and the first conductive layer; transmitting a second ESF hapticsignal associated with the second ESF haptic effect to a second ESFhaptic output device, mechanically coupled to a second portion of thesurface of the band and configured to output at least one dynamic ESFhaptic effect, and comprising: a second conductive layer electricallycoupled to the voltage source; and a second insulation layer disposed onthe second conductive layer to prevent contact between the user and thesecond conductive layer.
 34. The method of claim 33, wherein thewearable device comprises a smartwatch.
 35. The method of claim 33,wherein the first portion and the second portion of the surface of theband are different locations on the band.
 36. The method of claim 33,wherein the first portion and the second portion of the surface of theband are both located on an outer surface of the band.
 37. The method ofclaim 33, further comprising: outputting the first ESF haptic effectusing the first ESF haptic output device; and outputting the second ESFhaptic effect using the second ESF haptic output device.
 38. The methodof claim 33, wherein detecting the at least one contact furthercomprises detecting at least one characteristic of the at least onecontact.
 39. The method of claim 38, wherein the at least onecharacteristic of the at least one contact comprises at least one of alocation, a path, a pressure, a velocity, or an acceleration.
 40. Themethod of claim 33, wherein the wearable device further comprises aground electrode coupled to an outer surface of the band, the groundelectrode comprising a ground electrode conductive layer.
 41. The methodof claim 40, wherein the ground electrode further comprises at least oneof a ground electrode insulation layer or a conductive gel coupled tothe ground electrode conductive layer.
 42. A non-transitorycomputer-readable storage medium comprising program code, which whenexecuted by a processor is configured to cause the processor to: detectat least one contact on a wearable device comprising a band configuredto be secured to a user; determine a first electrostatic force (“ESF”)haptic effect and a second ESF haptic effect based at least in part onthe at least one contact; transmit a first ESF haptic signal associatedwith the first ESF haptic effect to a first ESF haptic output device,mechanically coupled to a first portion of a surface of the band andconfigured to output at least one static ESF haptic effect, andcomprising: a first conductive layer electrically coupled to a voltagesource; and a first insulation layer disposed on the first conductivelayer to prevent contact between the user and the first conductivelayer; transmit a second ESF haptic signal associated with the secondESF haptic effect to a second ESF haptic output device, mechanicallycoupled to a second portion of the surface of the band configured tooutput at least one dynamic ESF haptic effect, and comprising: a secondconductive layer electrically coupled to the voltage source; and asecond insulation layer disposed on the second conductive layer toprevent contact between the user and the second conductive layer.